PCT 



WORLD WllUJgn^F^ ORGANIZATION 




(21) International Application Number: PCT/US95/0I483 

(22) international Filing Date: 3 February 1995 (03.02.95) 



(30) Priority Data: 
108,565 



4 February 1 994 (04.02.94) n. 



(71) A PP"cant C£» jjl designated States except US): BARON MO- 

A^^S^ CA1TONS> WC - WW ^ Michael 
Aaar, 706 Chunelus Drive, Palo Alto, CA 94306 (US). 

(72) Inventors; and 

(75) toventorVAppUcMts aort/S^y): BARON, Ehud nun.]- 61 
H^g Street. 34980 Haifa (IL). GENOSSAR, Omrv ™ 

[HjU], 82/30 Hantke Street. 96629 Jerusalem (IL). 

(74) Agents: GALLOWAY, Peter, D.; Ladas & Parry 26 West 6U, 
Street, New York. NY 10023 (Us7e/aK * 



(81) Designated States: AM, AT, AU, BB. BG BR BY Ca ru 
CN, O. DE. DK, EE, ES. FI, GB, GE m J' kg 

ii.' bc » 'Ji? N( ^ropean patent (AT, BE CH DE 
DK, ES, FR, GB, GR, IE, IT, LU MC NL PT r- -nil; 

Published 

With international search report 

Before the expiration of the time limit for amending the 

be repMished in °"»< «5£ 



(54) Title: 



IMPROVED INFORMATION INPUT APPARATUS 




(57) Abstract 



- o^^StS. itu^P^40?^^ ^ fW V0lun ^ motions and 

outputs, and a ffloton o^ut ^ (140) ^S^^f^aS ^ 



3DOC1D: <WO_fteai43«tJL> 



FOR THE PURPOSES OF INFORMATION ONLY 

Codes used to identify States party to the PCT on the front pages of pamphlets publishing international 
applications under the PCT. 



AT 


Austria 


GB 


United Kingdom 


AU 


Australia 


GE 


Georgia 


BB 


Barbados 


GN 


Guinea 


BE 


Belgium 


GR 


Greece 


BF 


Burkina Faso 


HU 


Hungary 


BG 


Bulgaria 


IE 


Ireland 


BJ 


Benin 


IT 


Italy 


BR 


Brazil 


JP 


Japan 


BY 


Belarus 


KE 


Kenya 


CA 




KG 


Kyrgystan 


CF 


Central African Republic 


KP 


Democratic People's Republic 


CG 


Congo 




of Korea 


CH 


Switzerland 


KR 


Republic of Korea 


CI 


Cote dlvoirc 


KZ 


Kazakhstan 


CM 


Cameroon 


LI 


Liechtenstein 


CN 


China 


LK 


Sri Lanka 


CS 


Czechoslovakia 


LU 


Luxembourg 


CZ 


Czech Republic 


LV 


Latvia 


DE 


Germany 


MC 


Monaco 


DK 


Denmark 


MD 


Republic of Moldova 


ES 


Spam 


MG 


Madagascar 


FI 


Finland 


ML 


Mali 


FR 


France 


MN 


Mongolia 


GA 


Gabon 







MR 


Mauritania 


MW 


Malawi 


NE 


Niger 


NL 


Netherlands 


NO 


Norway 


NZ 


New Zealand 


PL 


Poland 


FT 


Portugal 


RO 


Romania 


RU 


Russian Federation 


SD 


Sudan 


SE 


Sweden 


SI 


Slovenia 


SK 


Slovakia 


SN 


Senegal 


TD 


Chad 


TG 


Togo 


TJ 


Tajikistan 


TT 


Trinidad and Tobago 


UA 


Ukraine 


US 


United States of America 


UZ 


Uzbekistan 


VN 


Viet Nam 



aPOaD: <WO__P62143CA1_L> 



WO 95*21436 

IMPROVED INFORMATION INPUT APPARATUS PCT/US95/01483 

1 



FIELD OF THE INVENTION 



for co m .ut The PrSSent inVenti ° n relates to input devices 
tQ f computers generally. 



BACKGROUND OF THE INVENTION 
U.S. Patent 4, 787, 051 to Olson describes an 

:::::::: mouse system which uses — — «* 

U.S. Patent 4,839,836 to LaBiche et. al de- 

llTLZlT ar&tUS Pr ° Viding SPatlU orLautlon 

clusterT USlng " iQertial Platf0rm •ccel.rom.fr 

cluster having a plurality of accelerometers 

eom * U ' S ' P3tent 5 ' 181 ' 181 to Glynn describes a 
computer apparatus input device fnr ^ , 
information. f ° r three -*imensional 
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SUMMARY OF THE INVENTION 

The present invention seeks to provide an 
improved input device. 

There is thus provided in accordance with a 
preferred embodiment of the present invention information 
input apparatus including body supported apparatus for 
sensing voluntary body motions and providing an output 
indication thereof, a symbol output interpreter operative 
to utilize the output indication for providing symbol 
outputs, and a motion output interpreter operative to 
utilize the output indication for providing motion con- 
trol outputs. 

Further in accordance with a preferred embodi- 
ment of the present invention, the output indication 
represents features of body motion including features 
which are characteristic of the individual. 

Still further in accordance with a preferred 
embodiment of the present invention, a mode selector is 
provided which is operative to cause a selected one of 
the symbol output interpreter and the motion output 
interpreter to function. 

Further in accordance with a preferred embodi- 
ment of the present invention, the body supported appara- 
tus is a hand held device. 

Still further in accordance with a preferred 
embodiment of the present invention, the body supported 
apparatus is a generally pen-shaped device. 

Additionally in accordance with a preferred 
embodiment of the present invention, the generally pen- 
shaped device is operative to provide a visible writing 
function. 

Still further in accordance with a preferred 
embodiment of the present invention, the information 
input apparatus also includes an object whose motion is 
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controlled by the motion control outputs. 

ment of * With * Preferred embodi- 

ment of the p resen t invention, the object is a cranM 
object displayed on a display or a physical object 
m*nt , * Urth6r " acco ^ance with a preferred embodi- 
ment of the present invention, the symbol outputs repre 
sent alphanumeric symbols or a sensory quality such as an 

such a S a v lsua i stimulus, including but not limited to a 
color or a color image. 

* " " aPPreCiated that **. applicability of the 
pres ent invention is very broad and is suitable L the 
follow^ fields of use, inter alia: games such as vid eo 

a fUght I" V6hiClSS ' r ° b0tiCS ' nation, such 

^ flight emulations, technical drawings and CAD 

Still further in accordance with a preferred 
embodiment of the present invention the JflTl 
input apparatus also includes a oo^. t^H^ 

Ployed by the computer to govern the Nation of tL 
information on the display. e 

ment of th""""" """a"" ' Preferred embodi- 

wtLV:::^;" inventi °- th ° — — — 

„,.. , " 4150 proviaea . in accordance with a 

preferred embodiment of the present invention a met,, , 
* -hich a nanipulable device provides an o tp^t ^ 
tion representing, its own angular mot- ■ n th„ 
including recording actual accelerate 'da I TtZTt 

J:!" 1 ^ -"lerometers mounted in the man! u UM 
device generating predicted acceleration data L tn. 
b is of hypothetical angular motion information, compel 
in, the predicted acceleration data to the actual ace"- 



SUBSTITUTE SHEET (RULE 26) 



WO 95/21436 PCT/US95/01483 



4 

eration data, computing improved hypothetical angular 
motion information, repeating, while the predicted accel- 
eration data differs significantly from the actual accel- 
eration data, the generating, comparing and computing 
steps, and providing an output indication of the improved 
hypothetical angular motion information. 

Further in accordance with a preferred embodi- 
ment of the present invention, the angular motion infor- 
mation includes angular displacement information, angular 
velocity information and angular acceleration informa- 
tion. 

Still further in accordance with a preferred 
embodiment of the present invention, the method includes 
computing linear motion information from the improved 
hypothetical angular motion information and from the 
actual acceleration data. 

Additionally in accordance with a preferred 
embodiment of the present invention, recording includes 
recording from at least four accelerometers mounted in 
the raanipulable device, wherein the accelerometers ' each 
have a center of mass and wherein the centers of mass do 
not lie within a single plane- 
Still further in accordance with a preferred 
embodiment of the present invention, the method also 
includes receiving the output indication of the improved 
hypothetical angular motion information and manipulating 
an object in accordance therewith. 

There is additionally provided, in accordance 
with a preferred embodiment of the present invention, an 
accelerometer array mounted in a raanipulable device and 
including at least four accelerometers each having a 
center of mass, wherein the centers of mass do not lie 
within a single plane, and a manipulable device motion 
computer receiving input from the accelerometers and 
generating an output signal indicative of the motion of 
the manipulable device. 
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Further in accordance with a prefers 
ment of the nme^ • P«terred embodi- 

ero.eters"^ * e " 1 »»«« fro. tne acoei- 

generate predicted accelerant a 

— ,=c:::L":"LL r ; dictea ac=ei — - - 

compute improved hypothetical angular m«n 
information, ««igu±ar motion 

provide an output indication of th. < 
Hypothetical anauiar .notion information ^ 

—t o f thr^!Li a * 00 T M,e * tfith a pcef " rea 

VJi Uiie present inventinn * 

-p Wa?o^i::\°; islts^.- 1 - ■ - 

-«„ in put method lnc L d LT sa in" " laf "- 

".otions and providing .„ ! <"> l »«t«y body 

-tui.^ „a p outpu: 3 in:; C a:r ■ 

outputs, and utiiizin, the output indicate ' Symb01 

1*9 motion oontrol outputs. tor provid- 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and 
appreciated from the following detailed description, 
taken in conjunction with the drawings in which: 

vl Fig. 1 is a simplified pictorial illustration 

of object control and handwriting recognition apparatus 
constructed and operative in accordance with a preferred 
embodiment of the present invention; 

Figs. 2A and 2B are schematic drawings of 
preferred structures of portions of the apparatus of Fig. 
1; 

Fig. 3 is a simplified block diagram of the 
apparatus of Fig. 1; 

Fig. 4 is a simplified flow chart illustrating 
the object control process performed by the apparatus of 
Fig. 1; 

Fig. 5A is a simplified flow chart illustrating 
the process of step 440 of figure 4; 

Fig. 5B comprises mathematical equations illus- 
trating the process performed by Fig. 5A; 

Fig. 6 is a simplified block diagram of the 
apparatus of Fig. 1; 

Fig. 7A is a simplified flow chart illustrating 
the teaching process performed by the apparatus of Fig. 
l; 

Fig. 7B is a simplified flow chart illustrating 
the recognition process performed by the apparatus of 
Fig. 1; and 

Figs. 8A and 8B are graphical illustrations 
useful in understanding a preferred method for a portion 
of the teaching and recognition processes performed by 
the apparatus of Fig. 1. 

Appendix A is a computer listing of a preferred 
software implementation of a portion of steps 720 of Fig. 
7A and 800 of Fig. 7B. 
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DETAILED DESCRIPTION OP PREFERRED EMBODIMENTS 

Reference is now made to Fig , „„,„,, . 

l ---* 1 "-Pl«orl^m..tr.t 1 «o£-JL. tli r " 3 

to perform motion control in synergist!^. """""^ 
symbol interpretation such as L2 r t lT"" 10 " 
>and-held pe » l0 is operative ^ ^ ^ T^?"- A 
ed about some or all of thro. translated and rotat- 

term degrees J^^™^ - 

-nsl^ion aiong and rotation about JS.*.^ 

acceleromete" 2 " ^ucYaTTf * Pl "" U ^ ° f 
mailable from Ic'sZ ^ 3 ° 31 - 2 «™rci.u y 

« 95035 . Preferably oe 1? MU >""< 
ters arrange! ill <*W«..ix accelerome- 

*en io also comprises a dIumh*.,. * 
30, associated with the plurality Q ff 

2A is a schematic drLng of a ' ^^^s 25 . 
of amplifier 30. Preferred embodiment 

— t y ^"it:::i; t :~ ~ -r- a 

also comprising associated M pl i(1 « T' "* 

above, may be retrofitted onto the Z 0 *» *** 
apx..,atus may have the form of a ca^ f tin, L""^ 6 
the Den a n nn • P £lttln 5 the end of 

able fL 9 £l " ln5 °" er "» « any other sult- 

ry not include S a U oen £ \ rther * lter "" 1 "- apparatus 
-d beld form" 1™^^™^™° 
ratus may be ln the £orm " \" ! 

finger, may be supported by tb. body o a u L 

- thereupon in any suitable matte/ ' " """^ 
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Pen 10 also comprises a switch 35, which can be 
used to send a signal indicating whether pen 10 is being 
used for handwriting recognition or as a pointing and 
control device. Alternatively the signal may be sent by 
moving pen 10 in a predefined format, or by any other 
appropriate means. During handwriting recognition, the 
user may write with pen 10. on writing surface 37. 

The data from the plurality of accelerometers 
25 in pen 10 is termed herein "accelerometer data". The 
accelerometer data is sent through a cable to a control 
circuit 40. Alternatively, the accelerometer data may be 
sent through any suitable wireless communication link, 
such as ultrasonic, infrared, or by any other suitable 
means . 

* Control circuit 40 amplifies the acceleration 
signals from pen 10 and converts them to digital form, 
preferably using an analog to digital converter. Fig. 2B 
is a schematic drawing of a preferred embodiment of an 
analog to digital converter suitable for the present 
application. 

Control circuit 40 then sends acceleration data 
to a CPU 50. CPU 50 may be any suitable CPU such as an 
IBM PC compatible computer with an 80386 processor chip. 

Associated with CPU 50 are a screen 60 and a 
keyboard 70. An object 80, such as a cursor or a graphic 
representation of a physical object, is displayed on 
screen 60. When pen 10 is used for object control, CPU 
50, based on the acceleration data, moves the cursor or 
graphic representation 80 with six degrees of freedom, 
corresponding to the movement of pen 10. 

A symbol 85, such as one or more characters or 
words, may also be displayed on screen 60. When pen 10 
is used for handwriting recognition, CPU 50, based on the 
acceleration data, displays the symbols corresponding to 
what is written on writing surface 37 on screen 60. , 

The functionality of the apparatus of Fig. 1 
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wxll now be described. Using switch 35 the user indi- 
ces whether handwriting recognition or object 
» to be performed. Depending on the user- s choice, the 
apparatus of Fig. , performs the appropriatg 

The functionality of the apparatus of Fig l 
wben performing obj,:;, control will now be briefly de- 
scribed. The user moves pen 10 in three dimensions; the 
notion may include six degrees of freedom. Pen 10 sends 
acceleration data describing the accelerations of pen i 
during the motion to control circuit 40. 

Control circuit 40 amplifies and digitizes the 
acceleration data. The data — 

cpu 5Qi The data 18 sent *y control box 40 to 

velocitv C? , U 50 C ° mPUteS ^ translati °^ displacement, 
velocity, and acceleration of pen 10 along three mutually 

hTlToTL axes which axes need have » — : 

the axes of the accelerometers. CPU 50 also computes the 
angular displacement (rotation) , velocity and a e 

1°: ir 10 around the saroe th - e — * ~- 

cursor or llT °* ^ ™ 50 moves th. 

L^L WPr "; atatiOB ° f " ° bj6Ct 80 ° n SC " en 60 
P n 10 Tn " : r ° tati0nS CO ™***^ to those of 
curs or Qr oh T e l ^ trans ^ion and rotation of the 
cursor or ob 3 ect correspond to the axes used to compute 
the translation and rotation of pen 10. 

Reference is now additionally made to Fig. 3 
which ls a simplified blocx diagram of the apparatus of 
Fig. l. Pen 10, when moved by the user with six degrees 

of llTT: tranSmitS deS «^ the accelerations 

of Pen 10 to amplification circuit 120. Amplification 

:he rcu a: 0 i 2 f °. a r ifies the » ^ : 

verter 130. Analog/digital converter 130 digitizes th. 
acceleration data and transmits the digitized L a 
d-placement/velocity/acceleration computation apparatus 
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140, termed herein DVA 140. 

DVA 140 computes the angular displacement, 
velocity, and acceleration of pen 10 around three mutual- 
ly perpendicular axes which axes need have no relation to 
the axes of the accelerometers . DVA 140 also computes 
thfe translational displacement, velocity and acceleration 
of pen 10 along the same three mutually perpendicular 
axes, 

DVA 140 transmits data describing the six 
degrees of freedom to screen display control 150. Based 
on the data, screen display control 150 updates screen 60 
to show the new location and orientation of the cursor or 
the other object depicted on screen 60. 

Reference is now additionally made to Fig. 4 
which is a simplified flow chart illustrating operation 
of the apparatus of Fig. 1 in accordance with a preferred 
embodiment of the invention. The preferred method of 
operation of the method of Fig. 4 includes the following 
steps: 

STEP 410: Read accelerometer data. Data 'from 
each of the plurality of accelerometers 25 is sampled, 
preferably at a rate of one thousand data points per 
second. 

. STEP 412: Check whether session is at the 
beginning. At the beginning of a session, STEP 420, 
described below, is required. 

STEP 415: Check whether pen is in motion. The 
accelerometer data is analyzed to determine whether pen 
10 is in motion. 

Preferably, pen 10 is considered to be not in 
motion whenever all of the acceleration signals indicate 
that the only sensed accelerations are due to gravity. 
Signals are chosen from one member of each of three pairs 
of accelerometers, each pair arranged along a different 
axis . 

Let the vector U»(U 1 ,U 2 ,U 3 ) denote the signals 
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of the three accelerometers . Let the matrix A= (K k k , 
denote the sensitivities of each of t-ho (K 1' K 2' K 3> 
ters. f the three accelerome- 

The sensitivities of thp 
*or any deviations of the a*e « .^7:?" 7*' 

=o»on axis on „ hich they „ e s " « ™ t*. 

"vi ty. Ihe sensitivities also correct for 

b*t»een the axes of the oiobal ortncoofT 

system and the axes of the pairs of ac^oL" 0 ^"" 6 

component of the sensitivity is cIluH '" 

ty- m actual practice. bo h Tute^"""" - 

- P «.. :::critT:;:etiT::L: s c rr as psrt of 



in 



ty at the earth's surface Th.n ,,, 9 " vl ~ 
»t to be in motion whenever ^-^.A'* 

JZJZL, c^r^itiTLr • - 

^r a .r :L t coordinate - - * or 9 ::: 

LtLi: ea . aCCeler ° m " erS - ""' M « are £ 

*Y. the static sensitivity can be computed f™ ^ 
accelerometer data while the pen is at re t in V 
no„n orientations. Alternatively, the stat c s Liti"' 
ty can be computed once as a property of Se ° Sltlvl - 
stored for future use. pe " Ma 
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STEP 430: Compute the differential signal from 
each pair of accelerometers . The signals from each 
member of each pair of accelerometers are subtracted to 
form a -differential signal for each pair of accelerome- 
ters . 

STEP 440: Compute rotational parameters. The 
rotational parameters define parameters of the motion 
about the three axes of the global coordinate system. 
The rotational parameters comprise the three Euler 
angles; the three angular velocities; and the three 
angular accelerations. 

The rotational parameters are computed in 
parallel using an iterative feedback loop. In each 
iteration of the loop, an estimated differential acceler- 
ation is computed from the current rotational parameters. 
If the difference between the estimated differential 
acceleration and the actual differential acceleration 
signal is less than a predetermined amount, iteration is 
terminated. 

Otherwise, new values of the parameters are 
estimated in each iteration from the previous values and 
the difference between the estimated differential accel- 
eration and the actual differential acceleration data. 
The method of this step is described more fully below 
with reference to Fig. 5. 

STEP 450: Compute translation acceleration. 
The angular orientation and the angular acceleration are 
known from step 440. From the angular orientation and 
the sensitivity vector the acceleration due to gravity is 
computed. 

Given the angular acceleration and the acceler- 
ation due to gravity as well as the sensitivity vector, 
the translational acceleration is computed. The computa- 
tion is according to the formula a^=K _1 u-ag-a r where a t 
is the translational acceleration; K is the sensitivity 
vector; u is the signal of one accelerometer; a_ is the 
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cogent of the acceleration of S rav« y sensed by ^ 
one accelerometer; and a r is the angular acceleration 
, m , . A STEP 455 : <* date «y»«ic sensitivity ' As 
«P1« ned above, the dynamic sensitivity represents 
deviations between the axes of the globL orthT 

::r aa ::„:rr ana the - ° f - ~- 

chanc.d T\ "* " ori « t ««« of Pen 10 may have 
changed, the dynamic sensitivity may also have chanced 

pen 10 th! iVe " T' Cha ° 9e in " e an3Ular °"*""ion 'of 
P« 10, the new dynamic sensitivity may be computed from 

.«.m«T" """"^ — - ~ 

displacement' Tnll^naT T^"" ~ 
1 . to „. f . ' translational velocity is computed bv 

integrating the translational acceleration with respect 
to time. The displacement is computed by integrating 
translational velocity with respect to time ' 

-put c/ZiiTstrw:^:::. - 
rjTcT- " iooity ana „:;r at :::: 

lar acceleration, velocity and orientating ..„ 
object is moved. The moving of the screen l, ! 
according screen object may be 

terpen ,r aPPrOPriatS ^ ~on of the mo- 

Reference is now additionally made to Pic « 
vhxch is a simplified flowchart illustrLnc J 
of step 440 of Pig 4 Pio „ AAu strating to operation 
steps: 9 * 5A lncludes the following 

tionai STEP 480: SSt initial Peters. The rota- 
tonal parameters comprise the three Euler angles- the 
three angular velocities; and the threp ,n , 
tions. The initial value for the Zll aCC6lera " 
" based on the previously kno^ vS^oJ ttlV" T 
assuming that the acceleration has reli T V* 1 ™^"' 

Stfp n remained constant. 

STEP 482: Compute dif f e rp„ H a , 
from model. Pirst the position of T ««l.ratioa 

position of an accelerometer in 
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the coordinate system of the pen is defined by vector r 
and the rotation of the pen in the global coordinate 
system is defined by a rotation matrix A(phi) . For 
example, A(phi) may be an appropriate rotation matrix as 
presented in sections 14.10-5 through 14.10-7, pages 475- 
48*0 of Mathematical Handbook for Scientists and Engineers 
by Korn and Korn, 2nd Edition, published by McGraw-Hill 
in 1968. Here phi is a vector of Euler angles: 
phi=(a,B,r) T . Then the position of the accelerometer in 
the global coordinate system R is defined by R=Ar. 

Reference is hereby additionally made to Fig. 
SB, which contains equations useful for understanding the 
steps of Fig. 5A. Equation 490 illustrates the computa- 
tion of the acceleration of the accelerometer in the 
global coordinate system. 

As the Euler angles of the accelerometer 
change, the sensitivity vector K also changes. The 
change in the sensitivity vector K may be computed by 
using equation 492 of Fig. 5B. 

Given the acceleration of the accelerometer and 
the new sensitivity vector, the estimated value for the 
differential signal of the 'accelerometer, u est may be 
computed by using equation 494 of Fig. 5B. 

The remainder of the parameters may be computed 
with an appropriate model. Preferably, a model which 
allows the use of only the parameters specified above, 
rather than a larger number of parameters, is used. For 
example,, equation 496 of Fig. 5B represents an appropri- 
ate model for computing the remainder of the parameters. 

STEP 484: Is the difference between the com- 
puted and the current value less than a predetermined 
amount? If the difference is less than this amount, the 
estimated parameters are taken to be correct and itera- 
tion is terminated, with the computed parameters being 
reported. 

An appropriate value for the predetermined 
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amount may vary depending on f or 

number of deslred iterati ' * ******** the maximum 
value would be .0003 g „ h ar. „ possi «»le appropriate 

tion Of gravity at the elrth """""^ <*• *=celera- 

jr tne earth's surface 

STEP 486, compute changes in .,ti„t.„ 
according to the gradient method Z e " 1\ , "" gl " 

section 20 .3- 3 0 f Mathematical Handh \ fU " y in 

a»d Engineers by Kor „ anfl K ^ »~ Scientists 

STEP 488- ^erred to above. 

'« th. re^il g *» values 

then continues with TZ 4a 2 C °" P " ea ' """^ 

-en Perfo^^r^I" ^ <* «»• . 

aescriLd. Pen ° «U now * 

"rough . control circuit 4 oto "« J!" 1 "" 10 " d " a 
"cognition tn occur based on t^"^^ ™ 

; - - "=ed^Vd^r:rr e 1 • 

1 when used for handwriting re" lit °* 
»*»■ « Pi.. 6 receives input L^TS"" W ^ 

^ "cogniton'apptLTtral " ^ 

accelerations of VlT^?^ 

«g control 630 and/or a= T ac «leration teach- 

"on control 650 handwriting reccgni- 

-eleratioTteX-nt*:: ll^*"""" * 
eration teaching control 630 typIcaUv ! *° a " el " 

Person who is to use the system f t " for ea = h 

«*« for the first ti„e 2 *1 "^"^ "cogni- 
taachin, control 630 also pS^""" *" taM ^"» 
"on errors are detected; use c L-"" *" " C °™- 

~« «. - «co S ; i t i :„i I ot e tr^ e :::r :: 



000: 



SUBSTITUTE SHEET (RULE 26) 



WO 95/21436 



PCT/US95/01483 



16 

termed herein adaptive teaching. 

.Acceleration teaching control 630 operates on 
the data received, which data represents hand movements 
by the user when writing a symbol, together with manual- 
ly-provided identification of the symbol codes that are 
associated with the data. Acceleration teaching control 
630 then updates database 640, a per-person per-symbol 
acceleration database. Database 640 comprises prototypes 
of accelerations for each symbol, comprising data specif- 
ic to each person for each symbol. 

Alternatively, the data from pen 10 may be 
transmitted to acceleration handwriting recognition 
control 650. Acceleration handwriting recognition con- 
trol 650 operates on the data received from pen 10 to 
recognize the symbol represented by the movement of pen 
10. 

The output of acceleration handwriting recogni- 
tion control 650 comprises a list of symbol codes and 
their respective probabilities. An acceleration hand- 
writing recognition post-processing circuit 660, chooses 
the correct symbol code based on the list of symbol codes 
and probabilities, and on post-processing information 
which preferably comprises a database of previous confu- 
sions and a dictionary. The output of acceleration hand- 
writing recognition post-processing circuit 660 is a list 
of symbol codes and/or words sorted by likelihood. 

Reference is now additionally made to Figs. 7A 
and 7B which are simplified flow charts illustrating 
operation of the apparatus of Fig. 7 in accordance with a 
preferred embodiment of the invention, when performing 
handwriting recognition. Fig. 7A illustrates the teach- 
ing process and Fig. 7B illustrates the recognition 
process. The steps in Fig. 7A include the following: 

STEP 710: Read accelerometer data. The accel- 
erometer data comprises data points representing sampling 
of the acceleration measured by accelerometers 25. 
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Preferably, the sampling rate is approximately 1600 data 

zzi r secona ' averasea ° ver 8 ^ 

output of approximately 200 data points per second 

STEP 712: Identify pen-surface contact termi- 
ng o n . The data from step ^ ^ 

r or?",:" 5 of pen io - ihe — 
s on :. 10 my be derivea f ™ tte 



The acceleration data is filtered to remove 
amponents other than noise. P or example, the accelera- 
tion data may he filtered by a Butterworth digital filter 
described in Bi3iisl ^ ^ by .... ^ ^ 
Burrus, Jo hn Wiley , Sons, „„. chapter 7 , tMiM 

cut-off frequency of 0.7 to 0.9. 

The filtered acceleration data is then int. 
.rated over time. The slope of the integrated il red 
acceleration data is then analyzed to determine the point 
•t which the slope exceeds a threshold value. The ooi^t 

I :T Sl ° Pe eX " edS «» value n 

to be the first point with status -pen down- The „ I 

•t which the slope falls below, a thresho d valuf s taxe" 
to be the first point with status -pen up- ; the t e 
value may or may not be the same a* ^ 
scribed threshold value. Previously de- 

The threshold values described above may be 
determined in advance for the particular type of pen anl 
writing surface, may be determined by a. learning ZocTs 
means PerS ° n ' " ^erminedV oth \" 

words tITI^I'' IdSntify individuai sy^ols and 
words. The data from the previous step i s divided into 

data representing individual symbols. The status which 

comprises the status of "pen up" ia terme „ „ 

. „ pcu U P ls termed herein "pen 

not down-. Preferably, the number of consecutive data 
points with status of -pen not down-, which data points 
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represent a particular duration of the status "pen not 
down" is taken to indicate the end of a symbol or of a 
word. 

Typically, the duration of status "pen not 
down" within a range from 200 milliseconds to 400 milli- 
seconds is taken to indicate the end of a symbol. Dura- 
tion of the status "pen not down" in the range from 800 
milliseconds to 1200 milliseconds is typically taken to 
indicate the end of a word. 

Alternatively, the end of a symbol or of a word 
may be indicated by data points which represent pen 
movements that are not part of a symbol, or by other 
means. Output data from step 715 comprises symbol end 
and word end data. 

STEP 720: Normalize accelerometer data. The 
accelerometer data is normalized in time or by other 
means. Appendix A is a computer listing in the C pro- 
graming language comprising routines that are a preferred 
implementation of step 720. The routines comprise the 
following routines in section II, "pre-preprocessing" : 
normal; together with various definitions used by routine 
normal . 

STEP 730: Filter accelerometer data. The 
normalized accelerometer data received from the previous 
step is filtered in order to remove noise. The filtering 
may be accomplished by iterative smoothing of adjacent 
points until the total change in the signal due to a 
smoothing operation is less than the desired accuracy of 
the data, or by other suitable means. 

STEP 740: Parameterize accelerometer data. 
The data is parameterized according to criteria which are 
chosen .to represent each symbol. If the accelerometers 
are not mutually orthogonal, the acceleration data may be 
converted into equivalent data in a mutually orthogonal 
coordinate system as follows: 

Let the non-orthogonal signals be denoted by 
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"to A is a vector of ^ ? 3 " ^ "'"V^u 

*-<^,*3> o f ;::° t r hr :: a eL^r^ 

sensitivity vector is computed from th utput ofT 

o™^ 1 i ^^r^~ tri *- of sensitivity ° f 

*1. * 2 . and a 3 . «»P"sl„g the norm, of 

The parameters preferably comprise the follow- 

number of points before ncnaalization- 
normalized signal of pen status- 
normalized signal of 2 acceleration- 

cosine of the angle a' • 

*>. angie"::^:":":::,:; 1? an5ia is as£i - a - 

before the previous data cit "° ~" 

and the current point (AccX. Acev , " 2 • AeeT i-2'* e «l-2) 
"at connects the curr n poin w^t J ' ' T 
subsequent point (AccX- III P<>i " 4ft,r th * 

u=cx.Acc r .Ac= Z) as »; l+a) in space 

and cosine of the angle c • ! 



step 750: Generalize parameter* 
tars of the symbol being learned r^res nt 
instance of the symbol. The svmhM SPeCi£1C 
t^e system is to represent he ITe^T^l * 
the symbol as drawn by that T characteristics of 
Parameters of the sy^o bei l^oT T " eref ° re ' ^ 
«- suitable means, such as ^ ^ '~ » 

symbol along with the value of each param- 
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eter from the current instance of the symbol. 

STEP 760: Update per-person per-symbol accel- 
eration prototype database. The newly computed parame- 
ters from the previous step are stored in the per-person 
per-symbol acceleration prototype database. 

The steps in Fig. 7B include steps which have 
already been described above with reference to Fig. 7A. 
The remainder of the steps in Fig. 7B include the follow- 
ing: 

STEP 800: For each prototype in the per-person 
per-symbol acceleration prototype database, build a 
measure ■ of comparison between the sample and the proto- 
type, combined over parameters in the prototype. In 
accordance with a preferred embodiment of the present 
invention, all parameters are combined together to pro- 
duce the measure of comparison. Appendix A is a computer 
listing in the C programing language comprising routines 
that are a preferred implementation of step 800. The 
routines comprise the following, which are found in 
section V, "symbols recognition": make_corr; correl_hem; 
obj_funct; together with various definitions used by the 
routines . 

STEP 810: Create a list of probable symbols 
sorted by likelihood. Based on the measure or measures 
of comparison generated in step 800, a single list of 
probable symbols sorted by likelihood is generated. 

STEP 820: Choose the correct symbols and the 
correct word based on the list, the database of previous 
confusions and a dictionary. The symbols with greatest 
likelihood are the candidates from which the correct 
symbol is chosen. 

The database of previous confusions provides 
information that allows the correction of the choice of 
the correct symbol based on previous incorrect identifi- 
cations. The database of previous confusions comprises, 
for each symbol, a list of other symbols which have been 
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sions for a wmhoi • , prisin 9 Previous confu- 

or a symbol in the list, the ?v »,h n i 

that have previouslv h« n * Y ° r svm *°ls 

yieviousiy been confused with i-h Q v , 

list are added to the list l! ? 01 " the 

Previous exaaple, 1£ th s^ol - f - "TT; ^ 
then the synfcol u the list ^ 

An indication of the end of each mr » v 
Passed as output since step 715 descrihl I 
« the indication, the »ost ikely word C o ' *"* 
—t lively identifications for each ^L, *"» 
is identified. yBbo1 " the "«t, 

a i=tio„ary The pr :f: r t ibl 1 ; k " h y T ^ ° heCked *»• 
general dictionary"^ \ ^l/T^ ^ > 
Personal dictionary for each user or ll * 
«try exists in the dictionary 1 l^"' " " 
-e word is chosen as the Z^^* 

dictionary" ^Zl^Z ™» «* - the 

are forced and each is ohlcW ^ ^ '"L'VT 
A»onc all such words which are fouM in th 
t>e word with the highest likelihood tLn choT^' 
the correct identification. Se ° as 

If none of the words i C ^ 

«y. the »ost likely word is I n a 7 he" diCU °- 
tification. the cor "ct iden- 

STEP 830: check to see if * 
been entered. During the process of C ° rreCti ° n has 
of the syst em is ^^'^J^^ ^ 
indication of each symbol recognize! * 

cation of the word recc, -,J. d It & iadi " 

manually that a given word wL iadiCate 
given woru was incorrectly recognized and 



OCK> 
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may input a correction. 

STEP 840: Update database of previous confu- 
sions. Based on a manual correction entered in step 830 
or an automatic correction based on the dictionary, the 
database of previous confusions is updated. Based on a 
manual correction, the personal dictionary is also updat- 
ed if the corrected word is not found in the dictionary. 

Preferred methods and apparatus for handwriting 
recognition are described in the following applications, 
the disclosure of which is hereby incorporated by refer- 
ence: PCT/US92/08703; Israel 104575; PCT application 
filed 31 January 1994 in the US Receiving Office by Ehud 
Baron and Edward A. Wolfe. 

It is appreciated that the particular embodi- 
ment described in Appendix A is intended only to provide 
an extremely detailed disclosure of the present invention 
and is not intended to be limiting. 

It is appreciated that various features of the 
invention which are, for clarity, described in the con- 
texts of separate embodiments may also be provided in 
combination in a single embodiment. Conversely, various 
features of the invention which are, for brevity, de- 
scribed in the context of a single embodiment may also be 
provided separately or in any suitable subcombination. 

It will be appreciated by persons skilled in 
the art that the present invention is not limited to what 
has been particularly shown and described hereinabove. 
Rather, the scope of the present invention is defined 
only by the claims that follow: 
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APPENDIX A 
Recognition according a combination of signals 

Definitions and rt.t^ ? tri l' tlir r - 
Board. H fjip 

0 - communication was established • 
//int init_datatr ( int *,'™ ^ (b ° ard " "* 7 

int newcomp ( void ) ; 

int reacLch ( int channel , int gain ) ; 

//int read^point ( struct point \ int ) ; 

/•int read.block (struct point * . int max.numb point 

int timeoutjor.begin , int tlmeouUbr end 
'nt key.mouse.stop ) ; */ " ' 

//int read.symbol ( struct point \ int , int ) ; 

int mshit ( void ) ; 

void close.datatr ( void ) ; 

define PORT.BASE 0x210 

^define KEY_STOP 0x1 
^define MOUSE.STOP 0x2 
define KEY_MOUSE_STOP 0x3 

#define PEN.WAIT 0x1 
#deftne PEN.NOWAIT 0x0 



Data.H fi| o 
struct point pen 
{ 

unsigned ax ; 
unsigned ay ; 
unsigned az ; . 
unsigned pn ; 

}; 

struct pointjablet 
{ 

int x ; 
int y ; 
int p ; 

}; 

#def!ne SYNCROBIT 0x80 



SUBSTITUTE SHEET (RUIE26) 



WO 95/21436 



PCT/US95/01483 



Datar.H file 

#define PORT_BASE 0x210 



^define DACO.LOW 0x2 

^define DACO.HIGH 0x3 

#define DAC1_L0W 0x4 

#define DAC1.HIQH '0x5 

#define CHANNEL. AX 0x4 
#define CHANNEL.AY 0x5 
#define CHANNEL. A2 0x6 
#define CHANNEL.PN 0x7 
^define STATUS Oxe 
#define CHANNEL.EMPTY 0x0 

#define ID REGISTER Oxf 

#define GA1N_1 0x00 

#defme GAIN_2 0x40 

#define GA!N_4 0x80 

#deftne GAIN_8 OxcO 

#define IER 0x21 
#define MR 0x20 

#define IRQO 0x08 

#define IRQ1 0x09 

#define IRQ2 OxOa 

#define IRQ3 OxOb 

^define IRQ4 OxOc 

#define IRQ5 OxOd 

#define IRQ6 OxOe 

#define 1RQ7 OxOf 

Tstruct point { 
unsigned ax ; 
unsigned ay ; 
unsigned az ; 
unsigned pn ; 

};v 

#define MINUS_PEN 1700 

/*#define PENJJP 0x2 

#defme PENJDOWN 0x4 
^define PEN.THRSLD 200 
#define EMPTY 0 7 

#define BUFSI2E 0x80 



#define TIME.COUNT 3000 
^include <dos.h> 



#define CSR 
#define GAIN 



0x0 
0x1 
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Ser.H flip 

/* 

FILENAME: SERIALH* " 

Some definitions used by SER.C 



#define COM1 1 

#define COM2 2 

*oS eSESiS ° X3F8 r Base port address ,or COM1 v 

define CQM2BASE 0x2F8 r Base port address for COM2 7 



The 8250 UART has 10 registers accessible through 7 port addresses 

thaMhTh 1 T addr6SSeS r6latiVe tC C0M1 8ASE and C OM2 B AS E N ote 
hat the baud rate registers, (DLL) and (DLH) are active only when 
the D-scr-Latch Access-Bit (DLAB) is on. The (DLAB) is ^7 oT 

o TXR Output data to the serial port. 

o RXR Input data from the serial port. 

o LCR Initialize the serial port. 

o IER Controls internet generation. 

o MR Identifies inter:-. ns. 

o MCR Send contorl signals to the modem. 

o LSR Monitor the status of the seriai port 

o MSR Receive status of the modem. 

o DLL Low byte of baud rate divisor. 

o DHH High byte of baud rate divisor. 

define IS ! " ™ X re 9 ister V 

#£Ina IPR ? ^ ReCeiVS r69iSter < READ > */ 

I2!2 ,? 1 ^ irrupt Enable 7 

2S e , 2» 2 r interrupt ID V 

^define LCR 3 * . ino ' 



^define MCR 4 r Modem control 

-jeflne LSR 5 Line status 



3 f Line control •/ 

7 

rri'l 3 r Line status •/ 

;Sf n e R 6 r Modem Status 7 

SIS! St ° '* Div ^or Latch Low 7 

#defme DLH t /• Divisor , atcn „ ' 



Bit values held in the Line Control Register (LCR)T 
bi * meaning 



0-1 
2 



00=5 bits, 01=6 bits, 10=7 bits, 11=8 bits 
Stop bits. 

3 0=parity off, l=parity on. 

4 0=parity odd, Imparity even. 
Sticky parity. 

6 Set break. 



5 



7 



Toggle port addresses, 

#define NO.PARITY 0x00 V 
^define £VEN_PARITY 0x18 
^define Of.. ...PARITY 0x08 
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/* * 

Bit values held in the Line Status Register (LSR). 
bit meaning 

0 Data ready. 

1 Overrun error - Data register overwritten. 

2 Parity error - bad transmission. 

3 Framing error - No stop bit was found. 

4 Break detect - End to transmission requested. 
5 S Transmitter holding register is empty. 

6 Transmitter shift register is empty. 

7 Time out - off line. 

* 7 

#define RCVRDY 0x01 

#define OVRERR 0x02 

#define PRTYERR 0x04 

#define FRMERR 0x08 

#define BRKERR 0x10 

#define XMTRDY 0x20 

#define XMTRSR 0x40 

#define TIMEOUT 0x80 

/* • 

Bit values held in the Modem Output Control Register (MCR). 
bit meaning 

0 Data Terminal Ready. Computer ready to go. 

1 Request To Send. Computer wants to send data. 

2 auxiliary output #1 . 

3 auxiliary output #2.(Note: This bit must be 
set to allow the communications card to send 
interrupts to the system) 

4 UART ouput looped back as Input. 
5-7 not used. 

* V 

#define DTR 0x01 
#define RTS 0x02 
#define MCJNT 0x08 

r * 

Bit values held in the Modem Input Status Register (MSR). 
bit meaning 

0 delta Clear To Send. 

1 delta Data Set Ready. 

2 delta Ring Indicator. 

3 delta Data Carrier Detect. 

4 Clear To Send. 

5 Data Set Ready. 

6 Ring Indicator. 

7 Data Carrier Detect. 

* 

#define CTS 0x10 
#define DSR 0x20 
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Bit values held in the Inte^Enab^eSi^ER) 
Dlt meaning 

° Interrupt when data received 

Interrupt when transmitter holding reg. emotv 
I n terrupt when data reception error. W 

^ iEST"" chanse in modem status re s ister ' 

#define RXJNT 0x01 7 



Bit values he,d in the Interrupt identification Register (IIR) 
u " meaning 



1-2 



Interrupt pending 
Interrupt ID code 



00=Change in modem status register 
01=Transmitter holding register empty 
lo=Data received, 

3 ' 7 Not useT 0 " 6rr ° r ' ° f break encounter <*. 



#define RX_ID 0x04 
#define RXJVIASK 0x07 



i SmrolfeTfRcf ° rt addrSSSeS °' 8259 Programmable Interrupt 

; S!c R R ^'nterruptMaskRegisterportV 
UX20 / interrupt Control Port •/ 



The 8259 wntTn ne H 6dS l ° bS SBnt t0 the Co ^rol Port of 
^ me 8259 when a hardware interrupt ends. 

define EOI 0 x20 r End Of Interrupt V 



/* 



S ne !^ 3 0XF7-/-COM2V 
#define IRQ 4 0xEF r CQM1 



/* 



Refine IR Q3 0 xF7 r COM2 •/ 

-define IR Q4 0 xEF r COM1 •/ 



xxmmm 8ei«aa»ij_» 
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int flag; 28 
int SetSerialQ; 

int SetOthers(int Parity, int Bits, int StopBit); 
int SetSpeed(int Speed); 
int SetPortfint Port); 
void init.serial(void); 
void comm_off(void); 

void setaitport(int Port, int Speed, int Parity, int Bits, int StopBit); 
int putchport (char); 
void putstrport(char *); 
int getchport(void); 
void offport(); 



Serconst.H file 

r • 

FILENAME: SERCONST.H 

Some definitions used by SER.C 
* v 



The 8250 UART has 10 registers accessible through 7 port addresses. 
Here are their addresses relative to COM1BASE and COM2BASE. Note 
that the baud rate registers, (DLL) and (DLH) are active only when 
the Divisor-Latch Access-Bit (DLAB) is on. The (DLAB) is bit 7 of 
the (LCR). 



o TXR Output data to the serial port, 
o RXR Input data from the serial port, 
o LCR initialize the serial port. „ 
o IER Controls interrupt generation, 
o IIR Identifies interrupts, 
o MCR Send contorl signals to the modem, 
o LSR Monitor the status of the serial port, 
o MSR Receive status of the modem, 
o DLL Low byte of baud rate divisor, 
o DHH High byte of baud rate divisor. 

V 

#define TXR 0 
#define RXR 0 
#define IER 1 
#define IIR 2 
#define LCR 3 
#define MCR 4 
#define LSR 5 
#define MSR 6 
#define DLL 0 
#define DLH 1 

#define DLAB 0x80 

r 

Bit values held in the Line Control Register (LCR). 
bit meaning 



F Transmit register (WRITE) V 
F Receive register (READ) V 



F Interrupt Enable */ 
F Interrupt ID */ 
F Line control V 
F Modem control */ 
F Line Status •/ 
F Modem Status */ 
F Divisor Latch Low */ 
F Divisor latch High V 



F V 
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define NO.PARITY 0x00 
#define EVEN.PARJTY 0x18 
#define ODD_PARITY 0x08 



00=5 bits, 01=6 bits 
Stop bits. 
0=parity off, 1=parity on. 
0=parity odd, 1=parity even 
Sticky parity. 
Set break. 

Toggle port addresses. 



29 

10=7 bits, 11=8 bits. 
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Bit values held in the Line Status Register (LSR)"' 
DIT meaning 



0 

1 

2 

3 

4 

5 

6 

7 



Data ready. 

Overrun error - Data register overwritten 
Panty error- bad trar^mission. 
Framing error . No stop bit was found 
Break detect ■ End to transmission requested 
Transmitter holding register is emiT 

Transmitter shift register is empty' 
Time out - off line. y ' 



^define 
^define 
^define 
^define 
#define 
^define 
#define 
"define 



RCVRDY 

OVRERR 

PR TVER R 
PR M ERR 
BRKERR 
XMTRDY 
XMTRSR 
TIMEOUT 



0x01 

0x02 

0x04 

0x08 

0x10 

0x20 

0x40 



0x80 



0 
1 
2 
3 



4 

5-7 



Data Terminal Ready. Computer readv to nn 
Request To Send. Computer wants to « ♦ 
auxiliary output #1 . 0 send data - 

auxiliary output #2.'(Note: This bit must be 
set to allow the communications carSt send 
interrupts to the system) d 
UART ouput looped back as input 
not used. . H 



^define DTR 
^define RTS 
^define MCJNT 



0x01 
0x02 



-7 



0x08 



Bit values he.d in the Modem Input status Regisier (MSR) 

meaning '* 



— »0143aAlJO. 
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0 


delta Clear To Send. 


1 


delta Data Set Ready. 


2 


delta Ring Indicator. 


3 


delta Data Carrier Detect. 


4 


Clear To Send. 


5 


Data Set Ready. 


6 


Ring Indicator. 


7 


Data Carrier Detect. 



0x10 
0x20 



r— 

Bit values held in the Interrupt Enable Register (IER). 



bit meaning 

0 Interrupt when data received. 

1 Interrupt when transmitter holding reg. empty. 

2 * Interrupt when data reception error. 

3 Interrupt when change in modem status register. 
4-7 Not used. 

• •/ 

#define RXJNT 0x01 



/ 

Bit values held in the Interrupt Identification Register (ilR). 
bit meaning 

0 Interrupt pending 

1-2 Interrupt ID code 

00=Change in modem status register, 
01=Transmitter holding register empty, 
10=Data received, 

11=reception error, or break encountered. 
3-7 Not used. 
• V 

#define RXJD 0x04 
#define RX.MASK 0x07 



r 

These are the port addresses of the 8259 Programmable Interrupt 
Controller (PIC). 

V 

#define IMR 0x21 r Interrupt Mask Register port V 

#define ICR 0x20 /* Interrupt Control Port V 



r 

An end of interrupt needs to be sent to the Control Port of 
the 8259 when a hardware interrupt ends. 

7 

#define EOI 0x20 r End Of Interrupt V 



r 
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The OMR) tells the (PIC) to service an interrupt only if it 
is not masked (FALSE). y 

/'unsigned char IRQ [8] = ( _„x01 , -0x02 , -0x04 , -0x80 

-0x10 , -Ox V 
•define IRQ3 0 xF7 f COM2 V 

#define IRQ4 0 xEF r COM1 V 

int SerSetPortBase ( int , unsigned • ) • 
jnt SerSetSpeed ( unsigned , long ) • 

In! sSS r ityS, ° PB i t ( UnSi9ned ■ int • int ■ 'nt ) : 
int serPutChar ( unsigned , unsigned char ) • 

jnt SerPutSiring ( unsigned , unsigned char * ) • 

mt SerlnitBuffer ( unsigned ) • '* 

mt SerGetChar ( unsigned ) •' 

int SerTestDSR ( unsigned )'• 

mt SerTestCTS ( unsigned ) ;' 

r int flag; 
int SetSeriai(); 

int SetOthersflnt Parity, int Bits, int StopBit)- 
mt SetSpeed(int Speed); 
int SetPort(int Port); 
void init_serial(void); 
void comm_off(void)'; 

«£S282£- '"' ■"-* Pa ^ w « »■*« 

void putstrport(char *); 
int getchport(void); 
void offport(); 
7 



3 
1 



0 



99 



Tablet. H fiio 
^define PEN_DOWN 
^define PEN__UP 
#define PEN_OUTPROX 
#define TBL_ WACOM II 
#define TBL_DATA_ASCII 
#define TBL.DATA BINARY 
#define TBL.MODE.STREAM o 
#define TBL_MODE_SWITCH_STREAM 
#define TBL_MODE_SUPRESSED n 
#deftne TBL_MODE_POINT q 
#define TBL.TYPE ABSOLUTE o 
#define TBL.TYPE -RELATIVE * 
#define TBL.MILLIMETERS 0 
#define TBLJNCHES 1 
#define TBL_ALWAYS_TRANSMIT YES 
-define TBL_ALWAYS_TRANSMIT~NO 
#define T8L_BAUD_1 9200 

#define TBL_BAUD~9600 fi 
^define TBL_BAUD~4800 t 
#define TBL_BAUD 2400 a 
#define TBL.BAUD 1200 ~ 
#define TBL.BAUD.600 \ 
#define TBL_BAUDJ00 ? 



1 
0 
7 
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#define TEL_BAUD_150 0 
#define TBL.PARiTY.NONE 0 
#define TBL.PARITY.ODD • 1 

#define TBL.PARITY.EVEN 2 
#define TBL.STOPBITS.1 o 
#define TBL.STOPBITS.2 1 
#define T6L_DSR_MONITOR_OFF 0 
#define TBL.DSR.MONITOR.ON 1 
#define TBL.DATALENGTH.7 0 
#define TBL_DATALENGTH_8 1 
#define TBL.TRANSFER.RATE.MAX 7 
#define TB L.TRANS FER.RATE.1 00 6 
#define TBl_TRANSFER_RATE_67 5 
#define TBL.TRANSFER_RATE.50 4 
#define TBL_TRANSFER_RATE_20 3 
#define TBL_TRANSFER_RATE_10 2 
#define TBL_TRANSFER_RATE_5 1 
#define TB L.TRANS FER_RATE_1 0 
#define TBL_ORIGINLOG.UPPER.LEFT 1 
#define TBL.ORIGINLOG.LOWER_.LEFT 0 
Sdefine TBL.DATA.TERMINATOR.CR.LF 2 
#define TBL.DATA_TERMINATOR.LF 1 
#define TBL.DATA_TERMINATOR.CR 0 



int read_point_tablet_pen ( unsigned , int , 

struct point.tablet • , struct point.pen *[8] ) ; 

int find.set.parameters.tablet ( int comport , unsigned 'portbase ) ; 

int init.tabiet ( int port , unsigned *portbase , int command.set , 

int data.format , int operation.mode , int origin.type , 

int unit.mesure , int aiways.transmit , int speed , 

int parity , int stopbit , int dsr.monitor , 

int datalength , int transfer_rate , int crig.log , 

int data.terminator , int max_x t int max.y ) ; 

void ciose_tablet ( unsigned portbase ) ; 
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™. ^„ re „ Ms S/M WM , a , a (rom , fte B , apwc (Miet aM 

struct poinLtablet tablet , ~ 
{ struct PoinLpen pen[8] ) ' 

int ind -Package = o , reply , debugflOl f • 

: n SS'^-'M'::.':..o,„ ); 

_ read^pointjen ( &pen[01 ) • 
i= 0 ; 

r Waiting for synchro-bit 7 

do 

( 

^((repiy = S erGetChar( P ortbase))<o) 
return reply ; ; ' J 

v debug[i^+] = reply ; 

if ( (Wcjigera = (char) reply ) & SYNCROBIT ) 
) while ( ind_package++ < 10 ) ; 
r Error ' No synchro-bit in 10 bytes V 

if ( ind__package >= 10 ) 
return SER_SYNCROBIT ; 

<■ «« » w . *„„, aw „ ^ , polntt _ acc#ieremtter v 

if ( read_pen ) 

{ 

} read_point_pen ( &penpnd_package] ) ; 

"(( reply = SerGetChar ( portbase ))< o ) 
return reply ; ' ' 

} packa 3 e n"d_package] = (char) reply ; 

f Read last point from accelerometer V 
if ( read_pen ) 
read_point_pen ( &pentind_package] ) ; 

r Calculates the values of the signals for tablet V 

ShS* >X = (packa9el °J &0x03 )<<i4; 
abe->x +Mpackage[1]&0x7 ^ • 

ablet->x +=( P ackage[2] &0x7«); 
" ( package[0] & 0x04 ) 

tablet->x = - tablet->x • 
tablet->y = ( pac kage[3] & 0x03 ) « 14 • 
tabe->y +=(package[4]&0x7 / ■ 
tablet->y += { package^] & 0 x7 f ; ' 



»aa<wo_8S2n3a» 1 j_ > 
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tablet->p = 0 ; 

if ( ! ( package[0] & 0x40 ) ) 

tabletop = 99 ; 
if ( package[3] & 0x04 ) 

tablet->y = - tablet->y ; 
if ( package[6) & 0x20 ) 

tablet->p = ( package[6] & 0x1 f ) ; 
return 0 ; 

} 



H. Pre-processing 

/* Two procedures: Normalization in time and filtering the input signals by smoothing 

7 

void normal ( int num old , float arr oidQ ( int num.new , float arr_newQ ) 

{ 

double koeff ; 

int ind_old , ind_new ; 

koeff = (double) ( num.old - 1 ) / (float) ( num.new - 1 ) ; 
arr_new[0] = arr_old[0] ; 

for ( ind.new = 1 ; ind_new < num.new - 1 ; ind_new -h- ) { 
ind.old = (int) ( floor ( koeff * ind.new ) ) ; 

arr_new[ind_new] = ( Ind.old + 1 - koeff * indjiew ) * arr_old[ind_old] + 

( koeff * ind_new • ind.old ) * arr_old[ind_o!d + 1] ; 
arr_new[ind_new] = arr_newpnd_new] ; 

} 

arr_new[ind_new] = arr_o!d[num_old-1] ; 



float smoothl ( int num , float zQ ) 
{ 

int ind ; 
float temp ; 
float norma ; 

for (ind = 1 , norma = 0 ; ind < num - 1 ; ind++ ) { 
temp = ( z[ind -1]+z[ind]+z[ind+1] ) /3. ; 
norma += abbs ( z[ind] - temp ) ; 
zpnd] = temp ; 

} 

return norma ; 
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'■ c***, , B . M , am „ er5 „ . symw „ om me inwt ^ 

jnt make_p ar ( char arg_ C h ) 

struct point { 

unsigned int x : 12 • 

unsigned int y ; 12 ' 

unsigned int 2 .• 12 * 

unsigned int pen : 4'; 
} Point , points[500]; 

int read.oext symbol ( Fi! c * «>♦ ^ . 
char file_name[40] ; ( ' StmCt po,nt D > ' 

jntlen, number_p 0 ints = 0 ■ 

*» i»«ex . 0 /m a » ^ ^ ' SU "^ a «NUMBER.POINT| ; 

Int ind , start ; 

;ntcur.x.cur.y,cur. 2 .curp- 

f ' 0at ^^Om-n , arrlyfMAX.PO.NT! . arr zfMAX POfNT! 

'or(ind = 0 : ind<6;ind ++) 
for ( ,ndex = o ; index < NUMBER =oimt • i„h 

paramnndXindex] = o.O • ' index++ > < 

} sur n_par[ind][index] = o.O ; 

/•Identification of the file of data V 

strcpy (ext.err.file.name)- 
return -4 ■ 

} 

start = 0 ; 
^ Reading data from file 7 

arr_x mdex] = (f| 0at) pointsfTndex Jc ) { 

arr_y mdex] = (float) pointsfindex y ' 
arr.z index] = (float) pointsfindex £ ■ 
j arr -Pf"dax] = (float) points[index].pen ; 

a"_P[0] = arr_p[max_point - 1] = 1 ; 
start++ ; 

number_points += max_point ; 
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/* Calculating the average of each parameter */ 

for ( ind = 0 ; ind < 6 ; ind+-r ) 
for ( index = 0 ; index < NUMBER_POINT ; index++ ) { 
sum_par[ind][index] param[ind][index] ; 

} 

} 

for ( ind = 0 ; ind < 6 ; ind++ ) 
for ( index = 0 ; index < NUMBER_PO!NT ; index++ ) 
sum_par[ind][index] /= start ; 

sum_par[0][0] = (float) number.points / start ; 
fclose ( in*Jile ) ; 

r write avg in Binary file */ 
sprintf ( file.name , "%03d.par" , (int) arg_ch ) ; 
outjetter * fopen ( fiie.name , B wb+") ; 
for ( index = 0 ; index < 6 ; index++ ) 
fwrite ( sum.parpndex] , sizeof(float) , NUMBER.POINT , outjetter); 

fclose ( outjetter ) ; 

return start ; 



void make.parjet ( float arr_xQ , float arr_yQ , float arr_zQ , 

float arr_pQ , float param[6][NUMBER_POINT] , int max_point ) 

{ 

float end_smooth; 

float new_arr_x[500] , new_arr_y[500] , new_arr_z[500] , new_arr_p[500] ; 
int ind , index ; 

r Call for pre-processing 7 

normal ( max.point , arr_x , NUMBER.POINT , new_arr_x ) ; 
normal ( max_point , arr_y , NUMBER.POINT , new_arr_y ) ; 
normal ( max.point , arr.z , NUMBER_POINT , new_arr_z ) ; 
normal ( max_point , arr_p , NUMBER_POlNT , new_arr_p ) ; 
max.point = NUMBER_POINT ; 
for ( ind = 0 ; ind < max_point ; ind++ ) { 

arr_x[1nd] = new_arr_x[ind] ; 

arr_y[ind] = new_arr_y[ind] ; 

arr_z[ind] = new_arr_z[ind] ; 

arr_p[ind] = new_arr_p[ind] ; 

} 

while ( ( end_smooth = smoothl ( max.point t arr_x ) ) > NUMBER J'OINT / 10 ) 
while ( ( end.smooth = smoothl ( max_point , arr.y ) ) > NUMBER.POINT / 10 ) 
while ( ( end.smooth = smoothl ( max_point , arr_z ) ) > NUMBER J'OINT / 10 ) 

/* Initialization of parameters 7 
param[0][0] = (float) arr_p[0] ; 
param(1][0] = ( arr_z[0] - arr_z[0] ) ; 
param[2][0] = 0.0 ; 
param[3][0] = 0.0 ; 
param[4][o] = 0.0 ; 
param[5][0] = 0.0 ; 
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r Calculation of parameters 7 
Param[l][ij»(arr.2[i]- a rr z[0] ) • 

param[4][i] = 0.0 ; J ; ' 

param[5][1] = 0.0; 

for ( index = 2 ; index < max.point - 2 • indM** \ r 
param[0)[index] s (float) arr p[index] •' > { 

Paramtunndex] « ( arr.zfindlx] - JJ Woi ) ■ 
elev arr_x[index + 11 - arr * LZl ' ' 
arr.zfindev 1] . 1J " 1] • + U - arr. y[in dex - „ . arr 2nndex + „ 

&param[2]findex] , &param[3irindex1 \- ~ J 

angles ( arr.xfindex + 2] - a°r_x f index] ' 
arr_yfindex + 2] - arr_y[index] ' 
arr_ 2 [index + 2].arr_z[index], 
arr_x[index] - arr_x[index - 21 
arr_y(index] - arr.yfjndex - 21 ' 
arr.zfindex] - arr_z(index - 2} ' 

index = *;Z &rnmn * e * ] • &para «<*] ) : 

} 

Paramjojpndexj- (float) arr. p[ index] • 
Paramrunndex] = ( arr_z(indei] - ar 2 [0] ) • 
elev ( arr_x[index + 1] - arr xfindex iV r- 
arr_ 2[ index - , ' U ■ -r^ndex + V . arr _ y[index . ^ _ 

Param[5][index] = o.O ■ 
index** ; 



/• Calcu at,on of parameters for last point V 
Param ojpndex]. (float) arr^index] 
Param[ijnndexj = ( arr zpndex] - ar zfOI 1 
Param[2][index] = o.O f f ] 3 

Param[3][indexJ = o.O ; 
param[4][index] = 0.0 * 
Param[5]findex] = o.O ' 



f Procedure eiev cartes the S,N and COS of the angie of elevation V 
«*» e,ev ( float x . float y . float z . float 'cos.uo , float . sin _ ug , 

float norma ; 

norma s (f] 0 at)sqrt(x- x + y y + 2 . 2) . 
it ( norma < ,00001 ) { 

*cos_ug a o.O ; 

*sin_ug = o.O ; 

return ; 

} 

•cos.ug = ( (f| 0at) sqrt ( x • x + y • y ) ) / norm _ . 
«"_ug = 2 / n o rma ; y ; ; / norma , 



return 

) 
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/• Procedure angles calculates the SIN and COS of the angle P */ 
void angles ( float x1 , float y1 , float z^ , float x2 , float y2 t float z2 , 



{ 

float normal , norma2 , x3 , y3 t 23 ; 
normal = ( float ) sqrt ( x1 * x1 + y1 * yl + z1 • 21 ) ; 
norma2 = ( float ) sqrt ( x2 * x2 + y2 * y2 + z2 * z2 ) ; 
if { normal < .0001 II norma2 < .0001 ) { 

*cos_ug = 0.0 ; 

*sin_ug = 0.0 ; 

return ; 

*cos_ug = ( x1 * x2 + y1 * y2 + 21 * 22 ) / normal / norma2 ; 
x3 s { yl • z2 - 21 * y2 ) ; 
y3 = ( x2 * 21 - x1 • 22 ) ; 
23 = ( x1 * y2 - x2 * y1 ) ; 

*sin_ug = ( (float) sqrt ( x3 * x3 + y3 * y3 + 23 * 23 ) ) / norrru 
return ; 

} 



float *cos_ug , float *sin_ug ) 
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IV. Training pr*^ Urr - 

r Procedure for preliminary teaching •/ 

int first jeach ( void ) 

FILE -fp ; 
P 'LH *f pout; 
int i; 

char buf[4] . NdxStr(4] . symbol S f256] • 
;n< ndx = o , max_symb = o • ' 
int num_sym; 

commeru ("converting data files. p. ease wait ._ 01) . 

» ( ( fp=fopen ( ■symbols.dar . V ) ) «. NULL , 

sfrcpy (ext_err.-symbols.daf)- 

nide.comment ("convertina data fii» e ». 

return (-4); 9 a ,l,es ' P ,eas e waif.O); 

while ( fscanf (f p ,-. /oS - fbuf } > 
J s rnbo,srma X .sy mb++] = bu , 0]; 

fpout=fopen ("texLadp", V); 

for ( ndx = o ; ndx < max symb ■ ndx*, w 
*Pnntf(NdxStr,-%03d~ ndx J H 
«l ( num. sym= maKe_ P ar ( symbols^ ) ) < = 0 ) 

} rlt^ZT^ menin9 data fileS ' ***** ^..0); 

else for (i=0;knum_sym;i ++ ) 
} fprintf ('P 0 ^-%c», S ymbol S [ndx]); 
'dose (fpout); 

re^n C ( oT; mem ( " C ° nVenin9 datS ^ ***** waif.O);. 
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^procedure for adaptation of prototypes V 

float huge •alljarpoo] ; 
int firsLadap ( void ) 

float old.rec , new rec ■ 
mt count=o f temp • 
char *text ; 
char str[80]; 

read_param { ) ■ 

comment (str -nv »™w_rec); 
do { ' ' 
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if (new_rec < 0 ) { 
hide_comment (str ( -1); 
while ( alLpar[temp] != NULL ) { 



farfree ( alLpar[temp++] ) ; 



return ((int) new_rec); 



if ( new_rec > .995 ) 

break ; 
old.rec = new_rec ; 

new_rec = recogn ( Iry.prl 0 , text ,1,0); 
if (new_rec <0 ) { 

hide^comment (str,-1); 

while ( all_par[temp] != NULL ) { 
farfree ( aILpar[temp++] ) ; 

} 

return ((int) new rec); 

} 

hide.comment (str,-1); 

sprintf (str,"%3f- in adaptation B ,new_rec); 

comment (str,-1,1); 

new. rec = recogn ( Iry.prr, text ,0,0); 

hide.comment (str,-1); 

sprintf (str,"%3f-after adaption",new_rec); 

comment (str,-1,1); 

if (new_rec < 0 ) { 

hide_comment (str,-1); 
while ( alLoar[temp] k NULL ) { 
farfree ( all par[temp++] ) ; 

} 

return {(int) new_rec); 



} while ( fabs ( old.rec - new_rec ) > .005 & count++ < 9 ) ; 
hida.comment (str,-1); 
farfree ( text ) ; 

while ( a!Lpar[temp] la NULL ) { 
farfree ( all_par[temp++] ) ; 

} 

return 0 ; 

} 
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V. Svmhrti'g rfr^nitjpn 

struct point { 
unsigned int x : 12 ; 
unsigned int y : 12 ; 
unsigned int z : 12 ; 
unsigned int pen ; 4- 

struct reply 
{ 

int ndx; 
float weight; 

}; 

J'oat recogn ( char . file .pen, char- text .int adapt, int wo rds) 

char symbols[256] , buf[4] * 
unsigned long m ; 
int max.symb; 

inS-"' 6 ' * fiie - symb • ■■ 

unsigned long start.word , end word • 
float param[6][NUMBER POINT] • ' 
mt index = o , max_pointl 
struct reply *repl ; 
int temp; 
int Ngood=0; 

int ind , NumSymbols ,ndx; 

struct point symb.pnts [MAX POINT? 

xsr ^ ■ -~=.n, . ^ 1MATO , ar ,_ ([M4X . 

int order^O; ^ 'J » 

char !etters[1 0][20J t dlcLwrds[1 01E01- 
»nt end_of_word=0; 
int wrdien; 

Joatsum[lO] t maxsum,ndx.maxsum; 
char org_wrd[20] t Lwordr20V 
int txt^width; 
int i; 

* ( ( file.symb = fopen ( 'symbols.dat" V ) ) - mi ,. , , , 
strcpy (ext_err.-symbols.dar)- ' NULL ) { 

return (-4): 

} 

for (ind=0;ind<256;ind ++ ) map[indl=-1 * 
max_symb = 0 ; 

while ( fscanf ( file.symb , -% S " f buf ) > 0 ) 

map [buf[0]]=:max_symb; 
^ symbols[max_symb++] = buf[0] ; 

fclose ( file.symb ) ; 
symbols[max.symb] = 0 ; 

f or ( ind = 0 ; ind < 6 ; ind-n- ) 



moocid: 
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for ( index = 0 ; index < NUMBER_P01NT ; index++ ) { 
param[ind][index] = 0.0 ; 

} 

if ( ( in Jile = fopen ( file_pen , "rb" ) ) == NULL ) 

{ 

strcpy (ext_err,file_pen); 
return -4 ; 

} 

index = 0 ; 
NumSymbols = 0 ; 
symb=-1 ; 

if (adapt) 

re.pl = make.corr ( param , symbols , symb) ; 



repl ts make_corr ( param , symbols , -1) ; 

if (repl[0].ndx<0) 
return ( rep I [0], weight); 

if (repl[0].ndx=symb) 

Ngood++; 
else 

Ngood = Ngood ; 

) 

fclose ( injile ) ; 
if (NumSymbols=0) return 0; 
else return (Ngood/(float) NumSymbols) ; 



r Calculation of the similarity of all the parameters of all the prototypes and the 
symbol to be recognized */ 

extern float huge *alLpar[100] ; 

struct reply 
{ 

int ndx; 
float weight; 

}; 

static int comm_count = 0 , abs_count » o ; 

int obLfunct ( float [100][7] , int , int , float [100] , float [7] , Int [10] ) ; 

float correLhem ( float [NUMBER_POINT] , float [NUMBER_POIN7] , float ) ; 

float correl ( float [NUMBER_POIN7] , float [NUMBER.POINT] ) ; 

struct reply *make_corr ( float cur_par[6][NUMBER.POINT] , char 'symbols ,int symb) 

FILE *cur_fiie ; 

int ind^repl , rnd_corrct , ind , max_symb , ind_symb , index ; 
struct reply arr_repl[30]; 
int arr_ind[10]; 

float res[100] , nres[7] , otd_max_pnt « cur_par[0][0] , com_wight ; 
float old_max_pnt2 , corrt100][7] , tmp_par[6][NUMBER_POINT]' ; 
char buf[8] ; 
Int iterat; 
struct reply rt; 
int i,j; 



else { 
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max.symb = strlen ( symbols > . 
for md_symb = 0 ■ ind «,mK ' 
^ ( i = 0 ; i < 6 f y < max - s V mb ind_sym b++ ) { 

f °'(j = 0;j<NUMBER_POINT-j++) 
tm P _p ar( i] 0 ] = alLpaiflnd symbm J ' . . 

" ( tmp.parfO]fOJ > 0 ) { * 11 ' 

cur_par[0J[0) = old.rnax pnt ■ 

corrfind_symb]fN_PAR.il = l' 0 * M 

( f3bS ( tmP - Par ^ - ) / our.pa.oKO, . , , , ; 

old_max_pnt = cur.parfOirrjl • 
tmpjarfOjro] = 1. ; J ' 

cur_pac(0][0] = 1. *' 



} 

} 

else 



} 



,or ( ind = 1; md < N .p AR . 1 • 

} corr(ind_symb][ind] = 0.0 ; ' * 



|f (symb<0) 



else 

'o'(i»0:j<NUMBER.p O INT-|„.| 



(iterate 19) break; 
tor (lnd.0. ind_corrct=0; ind<N PAR-1 • i nAl ^ 
f ( c °'^b]find]<0.95 • nrelnndj) ' d++) ' 

ind_corrct++; 

for (index=0; index < NUMBER.POINT • index^ 
tmp jarfindjnndex] . tmp Jar n*^^ 
) +cur -Par[ind][index]M; 
j f < C0rr fsymb][ind]<0.95 * nresfind]) 

incLcorrct-H-* 

, ,mp ~P a « - tm P _ P ar [0][ 0] • .9 + old.max.pnt • .1 

if (HncLcorrct) { 
iterat = 20 ; 
break; 

} 
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iterat-H-; 

cur_par[0][0]= old_max_pnt; 

corr[symb][N.PAR-1]=1-fabs(tmp.par[O][0]-cur.par[0][0])/ cur_par[0][0]; 
oid_max_pnt = cur_par[0][0]; 
old_max_pnt2= tmp_par[0][0]; 
tmp_par[0][0] = 1.; 
cur_par[0][O] = 1.; 

corr[symb][0] = correLhem ( cur_par[0] , tmp_par[0] , .9 ) ; 
for ( ind = 1 ; ind < N_PAR - 1 ; ind++ ) { 
corr[symb][ind] = correl ( cur__par[ind] , tmp_par[ind] ) ; 

} 

cur_par[0][0] = old_max_pnt ; 
tmp_par[0][0] = old_max_pnt2 ; 
} /• while 7 
} r else 7 

if ((iterat<20) && (index>0) && (iterat>0)) 
{ 

curjile = fopen ( buf , "w+b" ) ; 

for ( index = 0 ; index < NJ=>AR -1 ; index++ ) 

fwrite ( tmp_par[index] , sizeof ( float ) , NUMBER_POINT ( curjile ) ; 
fclose ( curjile ) ; 
for ( i = 0 ; i < 6 ; i++ ) 

for ( j = 0 ; j < NUMBER J»OINT ; j++ ) 
alLpar[symb][i*lOO+j] = tmp_par[H[j] ; 

} 

index = min ( index , 9 ) ; 
arr_ind[index]=-1; 
res[arr Jnd[index]]=-1 ; 
for (i=0;i<=index;i++) 
{ 

arr_repifi].ndx=arrjndp]; 
arr_repl[i].weight=-res[arrjnd[i]]; 

} 

return arr_repl ; 

} 



r Calculation of correlation between two vectors */ 

float correl ( float flrst[NUMBER_POINT] , float second[NUMBER_POINT] ) 



float sumxy = 0.0 , sumx = 0.0 , sumy = 0.0 , sumx2 ■ 0.0 , sumy2 = 0.0 ; 
int i_d , i_s ; 

for ( Ls = 0 ; Ls < NUMBER.POINT ; l_s++ ) { 
sumxy += first[Ls] * secondp_s] ; 
sumx first[i_s] ; 
sumy += second[i_s] ; 
sumx2 firstfus] * first[Ls] ; 
sumv2 += secondfl.s] * second[Ls] ; 

) 

if ( ( sumx2 - sumx * sumx / NUMBER.POINT ) < 0 II 
( sumy2 - sumy * sumy / NUMBER_POINT ) < 0 ) 
return 0 ; 

if ( ( sumxy » ( sumxy - sumx • sumy / NUMBER_POINT ) / 
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sqrt ( sumx2 - sumx • sumx / NUMBER POINT ) / 

return sumxy ; 



) 



r Similarity function for the parameter of pen up/down 7 

{ ~ ~ ( fioat par1[NUMBER _ POlNT] , float par2[NUMBETO 

int index ; ' 
float result e 0.0 - 

VlT* 7 w ; ,' ndeX * NUMB ^-POIN- ; index** ) 

result +a fabs ( pan [index] - par2[index) ) 
result /= NUMBER POINT • Par * l ' naex] ' 1 
result = 1 - result ; 
if ( result < border ) 

return 0 ; 
return result ; 

r Section of the ,ist of sym bols that are lite ,y to be the sym bo , to be recognized v 
l ntobLfunct(f,o a tarrnoo ][ 7 ] . intn _ symbi|nt 
{ float res[ 10 0] , float nres[7] , int a"rrindex[30] ) 

int ind_s , ind.p , ind.arr = o ; 

cur.res += ar^S^ '"^ < ^ ' «"4-P~ ) 

resfind_s] = c-r.res ; 
if ( cur_res > max.res ) { 

result = ind_s ; 
^ max_res = cur_res ; 

} 

abs_res s max_res * 85 • 
do { 

arrindex[ind_arr++] = result • 
resfresult] = - resfresutt] ; 

for ( ind.s = 0 , max_res = 0.0 • ind s < n ««m,h • 

W ( res[ind_s] > max res ) \ ' ' nd ~ s++ ) 

result = ind.s ; 
^ max_res = resfind.s] ; 

LmJli ma ^ r6S * abS ~ res && ind - arr < 30 ) • 
f °/ nd -P = °:^.p<n_ P ar;ind_ P++ ) >' 
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CLAIMS 

1. Information input apparatus comprising: 

body supported apparatus for sensing voluntary 
body motions and providing an output indication thereof; 

a symbol output interpreter operative to uti- 
lize said output indication for providing symbol outputs; 
and 

a motion output interpreter operative to uti- 
lize said output indication for providing motion control 
outputs . 

2 . Information input apparatus according to claim 
1 and wherein said output indication represents features 
of body motion including features which are characteris- 
tic of the individual. 

3. Information input apparatus according to either 
of claims 1 and 2 and also comprising a mode selector 
operative to cause a selected one of the symbol output 
interpreter and the motion output interpreter to func- 
tion. 

4. Information input apparatus according to any of 
the preceding claims and wherein said body supported 
apparatus is a hand held device. 

5. Information input apparatus according to any of 
the preceding claims and wherein said body supported 
apparatus is a generally pen-shaped device. 

6. Information input apparatus according to claim 
5 and wherein said generally pen-shaped device is opera- 
tive to provide a visible writing function. 
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7 - Information input apparatus acco-dina * 

the preceding cUi „ s and also CMprlslng ° C ^ * 

-tion is controlled by said motion control outputs 
«• Information input apparatus according to „, 

oo^ect is a physical object. 

£ Precedifr" ^ *> any of 

preceding claims and wherein . 

"Present alphanumeric symbols ^ °" P " S 

^* preceding 0 " aPPa " tUS aCCOrai "« « «T - 

preceding claims and wherein 

represent a sensory quality * ^ 

12 " Information input atmaraf« B . 

' - also comprising a 1" 

«* a symiol lnp u t . aod . ' operated bv ! ^ 

P«er and wherein said symbol LL^*. ' 

«« to be displayed on said L'pl / Ir?./"^- 

ontputs are supplied to said location < T " , ° ti0 " 

employed by the computer to goverHne lo T " 4 

information on said display. ° Catl °' 1 °. f 

or clairrand 0 \ lnPUt ^ * claim 

funcuo: c^l; ei ° saia ^ — 

-'output indlcaT ^ '* leh * Bani[,Ulabls P-vides 

a i4 output indication reDrespnfin^ < *. 

the method comprising ' " S " lUr m0t "°' 

recording actual acceleration data from a 
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plurality of accelerometers mounted in the manipulable 
device; 

generating predicted acceleration data on the 
basis of hypothetical angular motion information; 

comparing the predicted acceleration data to 
tlxe actual acceleration data; 

computing improved hypothetical angular motion 
information; 

while the predicted acceleration data differs 
significantly from the actual acceleration data, repeat- 
ing the generating, comparing and computing steps; and 

providing an output indication of the improved 
hypothetical angular motion information. 



A method according to claim 14 wherein the 

angular motion information includes angular displacement 

information, angular velocity information and angular 
acceleration information. 



16- A method according to claim 14 or claim 15 . and 

also comprising computing linear motion information from 
the improved hypothetical angular motion information and 
from the actual acceleration data. 

17. A method according to any of claims 14 - 16 
wherein recording comprises recording from at least four 
accelerometers mounted in the manipulable device, wherein 
the accelerometers each have a center of mass and wherein 
the centers of mass do not lie within a single plane. 

18. A method according to any of the preceding 
claims 14 - 17 and also comprising receiving the output 
indication of the improved hypothetical angular motion 
information and manipulating an object in accordance 
therewith. 
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wltWn a si ng i e p lane; ana " erS ° f "" s a ° »°t u, 

a manipulable device moHnn „ 
*»P»t from the accelerate! 1 

s^nal indicative of the motion of til " ° UtPUt 

vice. motion of the manipulate de- 

20 • Apparatus according to claim i, v 

manipulate device motion compute/ ^ tt * 

form ta. following steps: operative to per- 

acc e i eromet r I r C s 0 ; ding aC « le "tion data from the 

generating predicted acceleration „ «. 

computing improved hypothetic 
information; hypothetical angular motion 

while the predicted accelerate * 
significantly from the actual .ecll££ ^dT* 

*™-< ~g and ^ ^ " ^ 
Providing an cutout m^s P ' and 

•»tput , igaal 1Mica ' °£ \" » M1 I»l«tor receiving the 

ana „ anl p U1 ::: ; e :rr of the 

with. ooject in accordance there- 

in information input method comprising- 
sensing voluntary body motions . „ 

output indication thereof; ^ provi ^ng an 
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utilizing said output indication for providing 
symbol outputs; and 

utilizing said output indication for providing 
motion control outputs. 
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d 2 R r 6A d 2 a_ 8A d 2 fl _8A d 2 7 

TT2~" L a« "dT2" a/? ' dt2 ' a? 572" 

8 2 A ,da 2 8 2 A /d/? 2 3 2 A ^2 

tr a 2 A ^tf +2 J*A d«d7 2 a 2 A dfidy, . 

aaa/?' dt dt eotd? dt dt a/?ar dt dt J 
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